A Gold Standard for Scalar Adjectives
نویسندگان
چکیده
We present a gold standard for evaluating scale membership and the order of scalar adjectives. In addition to evaluating existing methods of ordering adjectives, this knowledge will aid in studying the organization of adjectives in the lexicon. This resource is the result of two elicitation tasks conducted with informants from Amazon Mechanical Turk. The first task is notable for gathering open-ended lexical data from informants. The data is analyzed using Cultural Consensus Theory, a framework from anthropology, to not only determine scale membership but also the level of consensus among the informants (Romney et al., 1986). The second task gathers a culturally salient ordering of the words determined to be members. We use this method to produce 12 scales of adjectives for use in evaluation.
منابع مشابه
Shifting Standards: Children’s Understanding of Gradable Adjectives*
Two studies demonstrate that children have knowledge of scalar distinctions between three sub-classes of gradable adjectives: relative (big, long), absolute with a maximal standard (full), and absolute with a minimal standard (spotted). Performance on these adjectives is compared with controls (shape, color, mood). Children appropriately shift the standard of comparison with context-dependent, ...
متن کاملMeaning and Context in Gradable Adjectives i Meaning and Context in Children’s Understanding of Gradable Adjectives
This work provides the first experimental evidence that adults and children as young as three years of age distinguish between three types of gradable adjective meanings – relative, absolute maximum standard, and absolute minimum standard – based on the role of the context in setting the standard of comparison. These results lend support to a typology of gradable adjectives determined by abstra...
متن کاملPredicative Adjectives: An Unsupervised Criterion to Extract Subjective Adjectives
We examine predicative adjectives as an unsupervised criterion to extract subjective adjectives. We do not only compare this criterion with a weakly supervised extraction method but also with gradable adjectives, i.e. another highly subjective subset of adjectives that can be extracted in an unsupervised fashion. In order to prove the robustness of this extraction method, we will evaluate the e...
متن کاملScale structure: processing minimum standard and maximum standard scalar adjectives.
Gradable adjectives denote a function that takes an object and returns a measure of the degree to which the object possesses some gradable property [Kennedy, C. (1999). Projecting the adjective: The syntax and semantics of gradability and comparison. New York: Garland]. Scales, ordered sets of degrees, have begun to be studied systematically in semantics [Kennedy, C. (to appear). Vagueness and ...
متن کاملAnnotation Scheme and Gold Standard for Dutch Subjective Adjectives
Many techniques are developed to derive automatically lexical resources for opinion mining. In this paper we present a gold standard for Dutch adjectives developed for the evaluation of these techniques. In the first part of the paper we introduce our annotation guidelines. They are based upon guidelines recently developed for English which annotate subjectivity and polarity at word sense level...
متن کامل